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INTRODUCTION 



Educational research, historically the domain of the individual educa- 
tor pursuing a problem with limited funds and reporting the results in an 
educational journal, has undergone a fantastic transition in the past ten 
years. Funds from the Federal Government, foundations, industry and agen- 
cies employing educators have made it possible to research a greatly in- 
creased volume of problems, including many which are too complex for the 

individual . 

This increase in educational research has led directly to a related 
problem, dissemination of research results, conclusions and recommendations. 
Although existing educational journals have expanded in size and many new 
journals have recently appeared, this medium of dissemination has proved 
insufficient. Educational societies such as AERA have expanded their paper 
presentations; many research reports come out in bound volumes and many 
books are written about research but dissemination of research remains a 
major problem in implementing research findings. 

Dissemination is a major concern of the foundations and the Federal 
Government, witness ERIC, but a question still exists: Are dissemination 

efforts pointed in the right direction? Another way of stating this ques- 
tion is: to whom should researchers disseminate research results? If 

research results are meant only for fellow researchers, the efforts men- 
tioned above may be adequate. If the goal of applied or developmental • 
research is its implementation in classrooms at all levels of education, 
there seems to be a question as to whether a good job is being done. In 
dissemination of research results to classroom teachers, there exist not 
only the common problem of wading through the sheer volume of research 
reports, much of it from little known sources, but also the lack of 
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research sophistication on the part of the potential recipients of these ■] 

reports. In view of the increasingly complex research being undertaken 

and the increasingly complex methods of analyzation and reporting being ■ 

: 

used, it is doubtful whether classroom teachers, especially those in j 

isolated rural areas, have the necessary knowledge to read and understand 
research reports. 

PURPOSES 

The immediate purpose of this study is to determine in what areas of 
research procedures and terminology teachers most need assistance. An 



outcome of this effort will be the development of an inservice education 
program to offer this assistance to teachers. The Educational Research 
Training Program at the University of North Dakota is supporting this effort 
by providing personnel to conduct the study and develop and pilot the in- 
service program. 

A long-range purpose is the development of procedures to disseminate 
research results to teachers in a form which will be understandable to them. 
It is not practical to expect teachers to become familiarized with research 
procedures as well as the subject matter of their teaching areas. 

PROCEDURE 

This study was undertaken to ascertain the level of familiarity which 
classroom teachers in North Dakota, a very rural state, have with common 
statistical, measurement and reporting terms commonly found in educational 
research reports. A research report judged to have rather general appeal 
to classroom teachers and more everyday language and fewer technical terms 
than the average research report was selected from AERJ . An accompanying 
questionnaire was developed which included attitude questions about the 
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appropriateness of the research procedures used and questions requesting 
respondents to indicate the sentences in the report which were the best 
example of a number of technical terms. A pilot sampling of teachers re- 
ceived this questionnaire in May of 1966, and from the results the ques- 
tionnaire was revised to its present form. 

The design employed was to select a random sampling of 500 AERA 
Division D members to serve as a criterion group. The responses of this 
group were statistically compared to the responses of a random sample of 
North Dakota educators to determine teachers' level of understanding of 
educational research procedures. 

A random sample of 794 North Dakota teachers and administrators repre- 
senting ten percent of the state's teachers was selected to receive the 
revised questionnaire. This sample was stratified according to the follow- 
ing variables: sex, years of educational experience and highest college 

degree earned. These variables were selected because they were shown to 
have the most meaning in differentiating between groups of North Dakota 
teachers by a statewide study of North Dakota's elementary and secondary 
programs under the direction of Kent Aim, University of North Dakota. 

The results reported in this paper are only preliminary because of the 
late date at which the questionnaires had to be mailed. The mailing delay 
was caused by a change in the teacher reporting procedures which made re- 
lease of the list of 1966-67 North Dakota teachers over two months late. 

As it is, the lists for the two largest cities in North Dakota still were 
not completed and are not included in the population from which the random 
sampling of North Dakota educators was drawn. Because the only two univer- 
sities which offer graduate programs are located in these towns, the popu- 
lation in this study represents teachers from small towns and rural areas 
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who do not have ready access to graduate programs. 

As of the cutoff date for this paper, 167 (21%) completely useable 
questionnaires had been received from North Dakota educators and 151 (30%) 
from AERA Division D members. Approximately thirty partially completed 
questionnaires and fifty returned questionnaires indicating the individual 
was not at that address were also received for each group. The causes for 
this partial response are two-fold; lateness of mailing the questionnaire 
and the length of time required to complete the questionnaire. 

FINDINGS 

The questionnaire used in this study contained 41 attitude questions; 
choice of response from "strongly agree" to "strongly disagree" on a five 
point scale. Two additional choices were provided; one was "insufficient 
information" and the other was "do not understand the question". 

Table I presents a statement of each of the 41 questions, and the 
percent of replies given by Division D members and North Dakota educators 
to the four categories: making an attitude choice, checking "insufficient 

information", checking "do not understand" and not responding. The chi 
square value with its associated degrees of freedom are also included. 
Questions 16 and 22 had chi square values significant beyond the .001 level, 
questions 18, 26 and 27 had values significant beyond the .01 level and 
question 24 was significant beyond the .05 level. These questions are con- 
cerned with the method of sampling, data-gathering methods, reliability of 
the data gathered and data-analyzation methods. In all cases a greater per- 
centage of AERA members had indicated "insufficient information" given upon 
which to base a response. 



Table II presents for each of the 41 attitude questions the percent of 



AERA members and North Dakota educators responding to each of the five ■ 
positions on the scale, total number of responses, degrees of freedom and 
the chi square value. Thirty-two of the forty-one chi square values were 
significant beyond the .05 level with 16 significant beyond the .001 level. 
For the majority of the questions having significant chi square values it 
appeared that North Dakota educators were somewhat hesitant in committing 
themselves, possibly from a lack of knowledge of research techniques. 

While the direction of responding (toward agree or disagree) was the same 
for both groups, North Dakota educators tended to respond more frequently 
"agree," "disagree" or neutral while AERA members responded more frequently 
"strongly agree" or "strongly disagree." 

The nine questions which did not have significant chi square values 
were interesting. Five of them asked whether the respondent could under- 
stand what was written in the article about the problem (question 1), data 
gathering methods (18), results (30) and conclusions (33), as well as 
whether tne article was biased (41). The other four questions, numbers 
19, 22, 26 and 27, dealt with the appropriateness and utilization of the 
data gathering and analyzation methods. 

For eight questions with significant chi square values there appeared 
to be substantial disagreement between AERA members and North Dakota educa- 
tors. In all but question 10, relationship of the problem to previous 
research, the North Dakota educators more frequently responded "agree" than 
did the AERA members. These questions basically asked whether sufficient 
information was provided in the article about the hypotheses (6), method 
of sampling (17), validity (23), reliability (24), data analyzation methods 
(29), and generalizations (38). This result seems to indicate that while 
teachers think they understand what has been written about research, still 
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their attitudes differ significantly from those held by AERA members con- : 

cerning certain technical methods and terms. 'I 

In summary of the attitude question results, it appears that two major ' j 

conclusions can be reached. One is that. North Dakota educators tend not j 

< 

j 

to strongly agree or disagree with the various questions about research 

i 

I 

procedures as compared to AERA members. Whether this reflects lack of " j 

knowledge concerning research techniques or normal teacher conservatism in I 

an educationally isolated state is hard to say; it probably is a combin- j 

i 

ation of both factors. The other major conclusion is that for ail ques- j 

tions but 1, 2, 5, 10, 11, 22, 23, 24, 26, 27, and 38, AERA members dis- j 

’ | 

agreed internally in their attitudes toward the question as indicated by ] 

I 

i 

the bi-modal response in the "agree" and "disagree" categories. Thus it j 

is difficult to pin-point a clear cut attitude difference between North j 

’ ! 

Dakota educators and AERA members. : 



The North Dakota educators were also compared on the variables used 
to stratify the sample; sex, educational position, years of experience and 
degree held, and an additional variable, size of school enrollment. The 
variables of position, enrollment and experience proved rather meaningless. 
This can be partially explained by the fact that more than three fourths 
of North Dakota school districts have less than 600 students in K-12. In 
these districts the administrator is just another teacher who has little 
if any free time for administration and leadership. 

It appeared on the questions concerning relationship of problem to 
previous research (10), reliability (24), data analyzation methods (28), 
(29), results (32) and writing of the report (39) that male educators and 
AERA members, who were also males for the most part, responded similarly. 

On questions 10, 28, and 39 and in addition, on definition of terms (9), 
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meaning of data analyzation methods (25) and unbiased attitude (41) the 
non-degree educators tended to report extensively more agreement with the 
questions than did the degree educators, and the B.A. degree educator more 
agreement than the master's degree educator. There was no apparent rela- 
tionship between the responses of any one of the three groups and the AERA 
members. 

It was felt that the responses to a series of attitude questions, while 
interesting, do not present very conclusive evidence as to educators' under- 
standing of education research procedures. Therefore 13 open-ended ques- 
tions were included to which respondents indicated numbers of sentences in 
the article which best described various research procedures or terminology. 
Table III gives the percent of AERA members and North Dakota educators who 
responded by indicating sentence numbers, circled "insufficient information," 
"do not understand," and did not respond to each question. The chi square 
values for all 13 questions were significant beyond .05 level. 

It must be noted that a much higher percentage of North Dakota educators 
returned the questionnaire without completing this section or leaving por- 
tions of it blank. This could indicate inability to cope with these ques- 
tions. In the case of sentences 2, 6, 12, and 13, this seems to be the 
explanation for the significant chi square values. 

For all questions there was a higher percentage of North Dakota educa- 
tors responding, "Do not understand." The difference in percentage ranged 
from 1.2% to 11.7%. It would appear that these educators especially "do 
not understand" limitations of the study (question 4), research design (5), 
data gathering methods (8), validity (9), reliability (10) and analyzation 
methods (11). For seven of the same 13 questions not a single AERA member 
responded "do not understand the question." 
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Another interesting feature was the percentage of responses to the j 

category "insufficient information." AERA members more frequently circled j 

this response than did North Dakota educators to questions about the prob- 
lem (1), assumptions (3), limitations (4), method of sampling (7), validity 
(9), and reliability (10). At the same time, AERA members less often wrote 
in sentence numbers to these questions even though they also less often 
left the questions unanswered or circled "do not understand." From this 
evidence it appears that either the AERA members wish additional informa- 
tion included in the article about the research procedures; information 
which is unnecessary for a response to the questions; or that North Dakota 
educators lack familiarity with research procedures and are attempting 
responses on the basis of insufficient information. 

The North Dakota educators were also compared on the same stratifica- 
tion variables shown in Table II. Except on the variable of experience 
the results were not significant. It was found that a much higher percen- 
tage of teachers with more than twenty years of experience did not respond 
to this section of the questionnaire. This, in turn, resulted in a lower 
percentage of responses indicating sentence numbers and/or a lower percen- 
tage of responses indicating "insufficient information." 

Table IV indicates the chi square values for the sentence responses of 
AERA members compared to North Dakota educators and for North Dakota educa- 
tors on the five stratification variables given in Table II. The procedure 
used to determine frequencies for the cells of the chi square tables in- 
volved first preparing a frequency table showing the number of AERA members 
marking each of the eighty-four sentences in the article in response to 
each question. The sentence numbers most frequently used in response to 
each question were given separate cells in the chi square table. All 
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frequencies for sentences below, above, or between sentence numbers given 
separate cells were summed up and placed in additional cells. Twelve of 
the thirteen chi square values for comparison between AERA members and 
North Dakota educators were found to be significant. A comparison of the 
frequency table for both groups indicated that for ten of the thirteen 
questions, the difference between responses of the two groups was rather 
small, usually a matter of selecting sentences differing at most by three 
or four numbers. Only for questions concerning limitations (4), 'analyzation 
methods (11), and conclusions (12) did there seem to be major disagreement 
between the two groups as to the most appropriate sentences. Table IV also 
presents the chi square values for the comparison of North Dakota educators 
on the variables shown in Table II. 

As of the writing of this preliminary report, no attempt had been made 
to consider all the implications posed by the significant chi square values 
for these 13 questions. A number of items need consideration. For instance, 
respondents could list from one to five sentence numbers in response to 
each question. It will be necessary to consider whether any significant 
difference exists in the number of sentences written in by the two groups, 
and to determine, where small differences exist in the sentence numbers most 
frequently selected by the two groups, whether the sentences are found in 
the same paragraph. This then is the major task remaining before prepar- 
ing the final report. 
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The major finding of this study is that there are statistically signi- 
ficant differences between North Dakota educators and AERA Division D mem- 
bers in attitudes toward and in choice of sentences which best illustrate 
various research procedures and terminology. The basic difference between 
the two groups seemed to be the hesitance on the part of educators to 
respond as evidenced by the higher percentage of neutral responses on the 
attitude questions, the unanswered questions on the open ended section and 
the greater tendency to check "do not understand the question" for both 
sections of the questionnaire. AERA members, on the other hand, rarely 
checked "do not understand" and were more definite in their responses, 
checking more frequently "strongly agree," "strongly disagree," and "in- 
sufficient information." 

A second finding is that there are differences between North Dakota 
educators when grouped by the variables of sex, position, experience, 
degree, and size of school enrollment. These differences were somewhat 
scattered but it appeared that whenever a significant difference did occur, 
rarely did any group of N.D. educators have responses similar to AERA members. 

It should be pointed out again that this is a preliminary report. While 
the writer feels that the evidence supports his belieT that teachers and 
administrators are unprepared to read with understanding educational research 
reports, the data presented could support different conclusions. In particu- 
lar the writer is aware of the problem of generalizing from too small a per- 
centage of returns. 

If any fact does seem clear it is that teachers and administrators do 
not seem to be applying research recommendations at the pace recc.. .mended 
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by researchers and knowledgeable educators. This is a problem of major 
concern if we want to develop the strongest educational system possible. 
Whether the conclusions reached in this article are agreed with or not, 

the data does provide interesting findings which indicate the need for 
additional study. 
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QUESTIONS 



PEJCENT gF RES|ONSES^ 



V r • NA’ 1 



1 . 

♦ 

2i 

j 

4. 

5. 

6 . 



The meaning of the problem studied for 



teachers. 

The problem is clearly written. 



The problem is described in sufficient 
detail. 



this research report can be understood, 



According to present research procedures 
the hypotheses are correctly stated. 



7. 



The meaning of the limitations to this 
research report can be understood. 



8. 



The limitations are described in 
sufficient detail. 



9. 

10 . 

11 . 

12 . 

13. 



Important terms are clearly defined. 



Relationship of problem to previous 
research is clear. 



The meaning of previous research in this 
research report can be understood. 



Previous research is described in 
detail. 



The meaning of the research design used 
in this research report can be under- 
stood. 



14,' The research design is described in 
sufficient detail. 



15. The. research design is appropriate to 
solution of the problem. 



16. The method of sampling is appropriate 



17. The method of sampling is described in 
sufficient detail. 
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5.9 


8.2 
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AERA 


85.5 


8.0 
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1.4 




N.D. 
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25. 
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27. 



28. 
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33. 



0 

ERIC 



imm 



m 



The meaning of the data-gathering 
methods used in this research report 
can be understood. 

According to present research procedures 
the data-gathering methods are appro- 
priate to solution of the problem. 

The data-gathering methods are clearly 
written. 

The data-gathering methods are de- 
scribed in sufficient detail. 

The data-gathering methods are utilized 
correctly. 

The validity of the evidence gathered 
is established. 

The reliability of the evidence gathered 
is established. 



The meaning of the data-analyzation 
methods used in this research report 
can be understood. 

Appropriate methods are selected to 
analyze the data. 

According to present research proce- 
dures the data analyzation methods are 
utilised correctly in analyzing the data. 

The data analyzation methods are clearly 
written. 

The data analyzation methods are de- 
scribed in sufficient detail. 

The meaning of the results given in this 
research report can be understood. 

The results are clearly written. 



The results are described in sufficient 
detail. 

The meaning of the conclusions given in 
this research report can be understood. 
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